Video2Flink: real-time video partitioning in Apache Flink and the cloud
نویسندگان
چکیده
Abstract Video2Flink is a distributed highly scalable video processing system for bounded (i.e., stored) or unbounded continuous) and real-time streams with the same efficiency. It shows how complicated tasks can be expressed executed as pipelined data flows on Apache Flink, an open-source stream platform. uses Kafka to facilitate machine-to-machine (m2m) communication between production that runs Flink. Features make combination of Flink desirable solution problem are ease customization, portability, scalability, fault tolerance. The application deployed cluster worker machines run Kubernetes in Google Cloud Platform. experimental results support our claims speed showing excellent speed-up all tested resolutions. highest more than seven times) was observed videos resolutions real time.
منابع مشابه
Approximate Stream Analytics in Apache Flink and Apache Spark Streaming
Approximate computing aims for efficient execution of workflows where an approximate output is sufficient instead of the exact output. The idea behind approximate computing is to compute over a representative sample instead of the entire input dataset. Thus, approximate computing — based on the chosen sample size — can make a systematic trade-off between the output accuracy and computation effi...
متن کاملState Management in Apache Flink®: Consistent Stateful Distributed Stream Processing
Stream processors are emerging in industry as an apparatus that drives analytical but also mission critical services handling the core of persistent application logic. Thus, apart from scalability and low-latency, a rising system need is first-class support for application state together with strong consistency guarantees, and adaptivity to cluster reconfigurations, software patches and partial...
متن کاملReproducible Experiments for Comparing Apache Flink and Apache Spark on Public Clouds
Big data processing is a hot topic in today’s computer science world. There is a significant demand for analysing big data to satisfy many requirements of many industries. Emergence of the Kappa architecture created a strong requirement for a highly capable and efficient data processing engine. Therefore data processing engines such as Apache Flink and Apache Spark emerged in open source world ...
متن کاملDevelopment of a News Recommender System based on Apache Flink
The amount of data on the web is constantly growing. The separation of relevant from less important information is a challenging task. Due to the huge amount of data available in the World Wide Web, the processing cannot be done manually. Software components are needed that learn the user preferences and support users in finding the relevant information. In this work we present our recommender ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Machine Vision and Applications
سال: 2023
ISSN: ['1432-1769', '0932-8092']
DOI: https://doi.org/10.1007/s00138-023-01391-5